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§ Copyright Notice: 

ffi The disclosure of this patent document contains material that is subject to copyright 

' i protection. The copyright owner has no objection to the facsimile reproduction by anyone of the 

^ 9 patent document or the patent disclosure, as it appears in the United States Patent and Trademark 

P> Office patent file or records, once a patent is issued on this application, but otherwise reserves all 

H copyright rights whatsoever. 
B 

R Field of the Invention: 

14 This invention relates to automated visual alignment, and particularly to locating objects 

1 5 using automated visual alignment. 

16 

17 Background of the Invention: 

18 The ability to determine the position and/or attitude of an object is of considerable 

19 practical importance in many applications, including industrial manufacturing, robot guidance, 

20 intelligent transportation systems, mail and parcel handling, and many others. Position might 
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1 include up to three degrees of freedom (e,g., up-down, in-out, and side-ways), and the three 

2 degrees of freedom of attitude (e.g., pitch, yaw, and roll). Together, these six degrees of freedom 

3 can be used to describe what can be referred to as the "location" or "pose" of an object. Note 

4 that here, "location" or "pose" can mean more than just position in three spatial dimensions - it 

5 can also include information as to the other non-translational degrees of freedom, such as skew, 

6 perspective, aspect-ratio, and many other more exotic non-translational degrees of freedom. In a 

7 two-dimensional plane, position includes two translation degrees of freedom (e.g., up-down and 

8 side- ways), and at least one non-translation degree of freedom, such as "orientation" (a rotation 

9 degree of freedom), and possibly skew, aspect ratio, size, and others. 

10 It is well-known to use machine vision to locate objects at a distance. A digital image of a 

1 1 scene containing an object to be located is formed by any suitable apparatus, for example 

12 consisting of visible light illumination, a CCD camera, and a video digitizer. The digital image is 
H then analyzed by a suitable image analysis device, for example consisting of a digital signal 

Jtl processor or personal computer running software that implements a suitable method for 

© identifying and locating image patterns that correspond to the object of interest. The analysis 

|j5 results in certain parameters that describe the pattern in the image that corresponds to the object, 

#7 or a suitable portion of the object, in the scene. These parameters might include position, 

M attitude, and size of the pattern in the image. These parameters are then used to compute the 

& location (pose) of the object using well-known mathematical formulas. 

M There are many methods known in the art for analyzing digital images to determine one 

21 or more of the pattem parameters, including blob analysis, normalized correlation. Hough 

22 transforms, and geometric pattem matching. Numerous other methods have been used or 

23 proposed in commercial practice or in academic literature. 

24 The process of determining object location (pose) by machine vision can be referred to in 

25 various ways, including "alignment", "registration", "pattem recognition", and "pattem 

26 matching". For present purposes herein, those terms are equivalent, and so herein the term 

27 "alignment" shall be used to refer to any such process. Any object, or portion of an object, that 

28 gives rise to the pattem in the image to be analyzed shall be called an "alignment target", or 

29 simply a "target". 
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1 Most machine vision alignment applications require locating targets having a shape 

2 determined by engineering considerations that are largely independent of the needs of automated 

3 visual alignment. In these cases, the objects contain no special markings or components specially 

4 adapted to aid the alignment method. Consequently, the alignment method must work with 

5 whatever object shape is given. There are many applications, however, where the alignment 

6 target can be engineered specifically for that purpose. Examples include fiducial marks on 

7 printed circuit boards, registration marks etched on silicon wafers, and "bull's eye" targets used 

8 by the United Parcel Service on package labels. A target that has been engineered to aid machine 

9 vision alignment can be called a "cooperative target" In contexts where it is clear that a target 

10 has been engmeered for alignment, the modifier "cooperative" is sometimes omitted, but 

1 1 "cooperative" is understood. 

12 Although alignment methods have an extensive literature and commercial history, 
11 relatively little work has been done on understanding the effect of target shape on alignment 

M performance. The work is almost entirely restricted to shapes composed of circles and polygons, 

ffl to the effect of such shapes on binary image analysis methods, to translation-only (i.e., horizontal 

£6 and vertical) alignment, and to accuracy criteria only. 

17 Rotationally symmetric targets, primarily circles and "bull's-eye" patterns, have long 

$3 been a favorite in the academic literature. In a 1974 paper, for example, W. Makous "Optimal 

W Patterns for Alignment", in Applied Optics, Vol. 13, No. 3, states that "a bull's-eye pattern of 

p regularly altemating black and white rings would be optimal for visual alignment in two 

21 dimensions." Twenty four years later, in a 1998 paper entitled "Design of Shapes for Precise 

22 Image Registration", in IEEE Trans, on Information Theory, Vol. 44, No. 7, Bruckstein, 

23 O'Gorman, and Orlitsky state that "Experimental tests and . . . theoretical developments ... led to 

24 the conclusion that the *buirs-eye' fiducial is indeed a very good, robust and practical location 

25 mark." 

26 Rotationally symmetric targets suffer from a number of limitations, however, that have 

27 not been anticipated in the prior art. First, such targets contain no information for measuring 

28 orientation. This has been considered an advantage, based on the assumption that alignment 

29 methods would fail under orientation misalignment unless the target is rotationally symmetric, 
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1 but the recent advent of practical methods for orientation alignment have created a need for 

2 targets that convey substantial orientation information. 

3 A second limitation of rotationally symmetric targets, such as the "bull's eye" pattern, is 

4 that circles and arcs of circles are extremely common in manufactured items, and one cannot 

5 guarantee that such shapes will not appear in the field of view containing the target. The 

6 appearance of such a shape in the same field of view as a target composed of circles or arcs of 

7 circles results in potential confusion for the alignment method, and this confusion usually leads 

8 to higher recognition error rates under variations in image quality typically encountered in an 

9 industrial environment 

10 A third limitation of rotationally symmetric targets is that they are often not good choices 

1 1 for measuring size, what might be called "size alignment". While such a target does contain 
B plenty of information for conveying size, the concentric circular boundaries match each other 
S perfectly at many different sizes. At the correct size the overall target match will be higher than 
fl at any of the wrong sizes, but the matches at the wrong sizes are sometimes good enough to 

§5 create confusion under realistic conditions of image degradation. This "self-confusion" can lead 

R to higher recognition error rates. Furthermore, this self-confusion generally requires that any 

17 practical alignment method must examine the "size" degree of freedom more carefully to avoid 

g error, which increases recognition time. 



y The academic literature has also considered using as alignment targets sunple polygons 

such as squares and diamonds, as well as complex sequences of stripes that are optimal for ID or 

21 2D alignment in some theoretical sense, but are almost impossible to manufacture. 

22 Known targets in commercial use include simple geometric shapes such as circles, buU's- 

23 eyes, squares, crosses, two squares touching at a comer, and patterns consisting of a cross 

24 embedded in a circle. 

25 In the semiconductor industry, significant attention has been given to the engineering of 

26 targets used to achieve the extreme accuracy needed to register the many layers created during 

27 wafer processing. Early targets consisted of interleaved comb structures, which were used by 

28 human operators in manual alignment systems prior to the advent of machine vision alignment. 
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1 More recently, manufacturers have used squares, concentric "box-in-box" shapes, crosses, 

2 circles, rings, bull's-eyes, and various other shapes comprised of rectilinear or circular features. 

3 Much of the prior art in semiconductors is concerned with process issues such as 3D structure, 

4 edge profiles, circuit design rules, and resist flow. 

5 Prior art cooperative targets suffer from one or more of the following limitations: 

6 • Target features are sometimes inadequate for providing sufficient information 

7 regarding non-translation degrees of freedom (e.g., orientation and size). 

8 • Reduced information is available when straight-line features are aligned (accidentally 

9 or otherwise) with the pixel grid. 

10 • Confusion and consequent reduced reliability result from use of curcles, curcular arcs, 
y line segments, or right angles, which are common in manufactured objects, and 

|§ therefore may be confused by the alignment method with other patterns in the scene. 

teB • Reduced rehability results from use of fine target features that do not survive a 

p- manufacturing process. 

|5 • Conftision and consequent reduced reliability result from target shapes that are "self- 

5 confusing", i.e., that match themselves too well when translated, rotated, or changed 

11 in size. 

18 • Reduced alignment speed results from target shapes that cannot be identified 

1 9 unambiguously by their coarsest features. 

20 For a number of reasons these limitations generally have not been serious for past use of 



21 machine vision. The alignment methods that have been available in the past, such as blob 

22 analysis and normalized correlation, had not been accurate enough (i.e., could extract only 

23 limited information from an image) to expose subtle limitations of the targets. Few practical 

24 methods existed for determining non-translation degrees of freedom, and those that were known 

25 were not widely used due to cost, reliability, or performance problems. Machine vision was often 

26 a new and challenging manufacturing technology, and so emphasis was placed on basic 
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1 functionality and not on squeezing high performance from the equipment. In electronics and 

2 semiconductor applications, among the largest users of machine vision, the coarser device 

3 geometries of the past placed limited demands on machine vision alignment. 

4 Recent developments have created a need for a new breed of cooperative targets: 

5 • The commercial availability of practical, highly accurate alignment methods capable of 

6 aligning non-translation degrees of freedom, including orientation and size, has created a 

7 need for targets engineered to provide sufficient information in all such degrees of freedom. 

8 • Expanding experience with machine vision alignment has shown that increased error rates 

9 often result from targets that can be confused with similar shapes in the field of view, or are 
10 self-confusing in one or more degrees of freedom. Thus, there is a need for targets not based 
i-1 on common features such as lines, right-angles, and circles, and for targets specifically 

engineered to minimize or eliminate self-confusion in all degrees of freedom. 

U • Shrinking sizes and tighter tolerances in manufactured goods, particularly in semiconductors 

fk and electronics, are placing increasing demands on accuracy, speed, and robustness of 

& machine vision alignment. Consequently, there is a need to reconsider the often-neglected 

l6 role of target shape, and produce targets that cooperate with practical alignment methods to 

5^ achieve best performance. 

The need for new cooperative targets not subject to the limitations of the prior art leads to a need 
for new methods for engineering such targets. Prior art methods for engineering targets suffer 

20 from one or more of the following hmitations: 

21 • The known target engineering methods address only translation alignment, not other 

22 degrees of freedom such as orientation and size. 

23 • The known target engineering methods are based on a theoretical analysis of absolute 

24 accuracy, which to avoid intractable complexity, requires unrealistic simplifying 

25 assumptions about image quality, requires that target shape be restricted to simple shapes 

26 composed of circles and rectilinear edges, and requires the use of simple binary 

27 alignment methods, such as blob centroid. 
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1 • The known target engineering methods do not consider alignment speed. 

2 • The known target engineering methods do not consider alignment reliability under 

3 practical conditions of image variation and process degradation. 

4 • The known target engineering methods do not consider confusion with other patterns and 

5 self-confusion. 

6 Consequently there is a need for a new method for engineering alignment targets. 

7 Another factor contributing to reduced performance of known cooperative alignment 



8 targets is insufficient precision in known methods for rendering such targets. Without the ability 

9 to render a cooperative alignment target at very high precision, an alignment target engineered to 
10 address the problems of the prior art would not perform optimally. Consequently, it is necessary 
ti to be able to render such targets in various forms, including bitmap images, at very high 

15 precision. In the prior art, methods for rendering shapes accurately on a discrete grid have been 



Q studied extensively for graphics applications, where they are generally referred to as anti-aliasing 

r| methods. These methods produce pleasing graphics for human observation, but achieving the 

i§ extreme accuracy and flexibility needed for machine vision alignment applications is difficult. 

§ In the machine vision prior art, several methods have been used to render binary shapes 

1§ on discrete grids. In one method, pixels along the shape boundary are given a gray value 

IJ corresponding to the fraction of the pixel's area that falls on either side of the boundary. This 
method suffers from several limitations: 

20 • The computations are complex, resulting in very slow rendering that makes 

21 automated testing using thousands of synthetically generated images impractical. 

22 • The method assumes an unrealistically ideal sensor model, resulting in loss of 

23 accuracy. Attempts to improve the sensor model by post-processing the rendered 

24 image are also limited in accuracy due to grid quantization. 

25 • The method is impractical for complex shapes that are not composed of straight-line 

26 segments. 
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1 In another known rendering method, a binary image is rendered at much higher resolution 

2 than that needed for the target rendering. This high-resolution image is then filtered and sub- 

3 sampled to produce the final rendering. While such a method can be quite accurate in principal, 

4 computer time and memory limitations make truly high accuracy impractical 

5 



6 Summary of the Invention 

7 It is well-known in the prior art to cause a cooperative target to appear on an object to be 

8 located, place the object within the field of view of a camera or other suitable image formation 

9 device, capture an image of the object bearing the target, and analyze the image using an 
10 alignment method to determine the x-y position of the target in the image. 

y The invention includes a method and apparatus for locating objects by means of machine 



ft vision alignment using cooperative targets. The method and apparatus provides significant 

M improvements over the prior art. In one general aspect, the invention uses novel cooperative 

il targets that have substantial performance advantages over those used in the prior art. In another 

£5 general aspect, the invention uses alignment methods having non-translation aUgnment 

ijS capabilities, such as geometric pattern recognition, cooperating with suitable targets to perform 

P alignment in non-translation degrees of freedom, such as orientation and size. 



S The invention includes a novel set of criteria for evaluating alignment targets for 

ft accuracy, speed, yield (robustness), and ease of use. The accuracy criteria of the invention are 

20 based on a quantitative analysis of target boundary shape that has several advantages over prior 

21 art methods: 

22 • The accuracy criteria of the invention can be used for essentially arbitrary shapes; 

23 • The accuracy criteria of the invention provide estimates of the information content of 

24 a cooperative target, independent of any specific alignment method; and 

25 • The accuracy criteria of the invention can evaluate targets for their capacity to 

26 accurately aUgn non-translation degrees of freedom, such as orientation and size. 
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1 The accuracy criteria of the invention also include a quantitative measure of the tendency 

2 of a target to contribute to loss of accuracy due to accidental alignment with the pixel grid of the 

3 machine vision system, a phenomenon referred to herein as "grid degeneracy'*. This phenomenon 

4 has been recognized in academic research, although useful remedies appear not to have been 

5 investigated, and many cooperative targets in current use suffer from this problem. 

6 Although speed criteria are apparently unknown in the prior art, an aspect of the 

7 invention includes qualitative criteria based on certain common characteristics of most practical 

8 alignment methods in use, which are in turn loosely based on principals of information content. 

9 Yield criteria are also apparently unknown in the prior art, with the exception of targets 

10 used for wafer fabrication in the semiconductor industry, where the criteria are specific to wafer 

1 1 processing. For high yield (low error rates), an aspect of the invention considers the ability to 
O survive manufacturing processes and other environmental conditions. Another aspect of the 
15 invention includes criteria relating to potential errors caused by self-confusion and background 
ly^ confusion. 

pj The ease-of^use criteria of the invention require that targets be easy to render on the 

1% objects to be located, easy to teach to the machine vision alignment method, and easy to analyze 

1^ using the criteria of the invention. To satisfy these ease-of-use criteria, the invention uses targets 

11 that are defined by a set of algebraic formulas. 

0 The invention includes a novel method of accurately rendering algebraically defined 

20 shapes that can be used to render alignment targets, or for other purposes. The method can render 

21 shapes as a bitmap image for machine vision alignment training, for computer display for human 



22 observation, and for computer printout for documentation. The method can aid in rendering 

23 targets on the objects to be located by providing input to a computer-aided design (CAD) system, 

24 or by directly controlling devices such as laser engravers. The rendering method of the invention 

25 is fast, extremely accurate, and can handle substantially arbitrary shapes. 

26 The rendering method according to the invention includes two key steps: first, targets are 

27 defined by a real-valued function of position in the real plane that gives the distance from that 

28 position to the nearest point on a target boundary. The function gives distance as a positive value 
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1 for points inside the figure, and as a negative value for points outside the figure; and second, an 

2 edge model is used to map distance to real-valued image intensity. By choosing appropriate edge 

3 model parameters, edge sharpness, focus, video gain, and noise can be modeled. Other steps are 

4 used with these two key steps to provide a complete rendering method. In a preferred 

5 embodiment, the rendering method of the invention uses high-precision floating point arithmetic 

6 to estimate real-valued functions on the real plane, and only converts to a discrete grid as the 

7 final step. The result is the ability to control the position, orientation, and size of the final 



8 rendering to extremely high precision. 

9 The invention includes a novel method for engineering alignment targets that satisfy the 

10 above set of criteria of the invention. By contrast, known methods generally try to analyze a set 

11 of specific shapes, such as a circle, square, and diamond, and then simply choose the best one. 

12 Alternatively, in some known methods, a single parameter such as aspect ratio might be 

|| optimized according to some criteria. The method of the invention for engineering alignment 

f 4 targets, by contrast, starts with a simple shape and then refines the initial shape in a series of 

is steps, where each such step produces a different shape, derived from the previous step, that 

16 resolves some deficiency of that shape. 



17 Li one embodiment of the method for engineering alignment targets, the initial shape 

1^ contains radial features, which carry orientation information but not size, and circular features, 

which carry size information but not orientation. As recognized by the invention, this 

3D independence of radial and circular features allows orientation and size performance to be 

'2I adjusted independently. 

22 In another embodiment of the method, the starting shape is defmed algebraically using 

23 polar coordinates. Jn a preferred embodiment, the starting shape is a "fan". 

24 In a preferred embodiment, the series of steps includes at least one step whose purpose is 

25 to achieve at least one of the following goals: 

26 • Increase boundary perimeter to improve accuracy. In a preferred embodiment, 

27 perimeter is increased by adding holes. 
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1 

2 



• Balance orientation and size accuracy, so that the target is not overly biased towards 
one degree of freedom at the expense of the other* 



3 • Reduce or eliminate rotational symmetry. 

4 • Reduce or eliminate orientation self-similarity. 

5 • Reduce or eliminate size self-similarity. 

6 • Reduce or eliminate grid degeneracy. 

7 • Reduce or eliminate features that are common in manufactured items, such as circles, 

8 circular arcs, straight lines, and right angles. 

The alignment target engineering method of the invention provides at least the following 

® benefits: 

j| • The alignment target engineering method of the invention allows objective, 

|i quantitative comparison of the ability of different shapes to convey alignment 

© information in all relevant degrees of freedom, including translation, orientation, and 

M size. 

K • The alignment target engineering method of the invention avoids fruitless theoretical 

R attempts to determine absolute accuracy, and instead allows analysis of arbitrary 

t7 shapes with no assumptions about image quality or the alignment method to be used. 

18 • The alignment target engineering method of the invention takes into account the 

19 effect of target shape on the speed of practical alignment methods in common use. 

20 • The alignment target engineering method of the invention takes into account the 

21 effect of potential confusion with other patterns, and self-confusion, on alignment 

22 reliability. 

23 The invention includes specific alignment targets that have at least one of the foUowmg 

24 attributes: 
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1 • They satisfy the invention's evaluation criteria. 

2 • They result from the use of the invention's engineering method. 

3 • They have no significant rotational symmetry, 

4 • They have no significant orientation or size self-similarity. 

5 • They are not primarily composed of circles, circular arcs, straight lines, or right 

6 angles. 

7 In one embodiment, the specific alignment targets are shapes consisting of at least one 

8 "generalized polar polygon,*' A generalized polar polygon is a plane figure that is a polygon with 

9 optionally rounded vertices when drawn in polar coordinates, keeping in mind that all 

® coordinates (r, 9 + 360°n), for integer n, are the same point. Such a figure will include radial 

H lines, circular arcs, and spiral segments when drawn in the Cartesian plane. 

In another embodiment, the specific alignment targets are members of a family of "fan" 

M shapes. 



=!L4 In a preferred embodiment, the targets are fan shapes that satisfy all, or almost all, of the 

ffS evaluation criteria established by the invention. These are novel shapes that have no prior history 

it6 in mathematics or practical arts. Any target that substantially satisfies all of the evaluation 

JC7 criteria is called a "Universal Alignment Target" (UAT). 

18 

1 9 Brief Description of the Drawings 



20 The invention will be more fully understood from the following detailed description, in 

21 conjunction with the following figures, wherein: 

22 Figure 1 shows a typical cooperative target in common use, and illustrates some of the basic 

23 properties of targets considered by the invention. 



24 Figure 2 illustrates how the figures of merit used for the accuracy criteria are computed. 
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1 Figure 3 illustrates an accidental alignment of a target to the machine vision system's pixel grid, 

2 which results in loss of information called a "grid degeneracy". 

3 Figure 4 illustrates the alignment speed criteria. 

4 Figure 5 illustrates the alignment yield criteria. 

5 Figure 6 illustrates a target defined by a set of algebraic formulas to satisfy the ease of use 

6 criteria. 

7 Figure 7 illustrates a preferred rendering method according to the invention. 

8 Figure 8 shows an edge model used in a preferred embodiment of the rendering method, 

9 Figure 9 illustrates some common alignment targets that are used as a reference point in the 
W engineering of novel, high performance targets according to the invention. 

fl Figure 10 illustrates a starting shape, the "primitive fan", according to a preferred embodiment of 

K the target engineering method of the invention. 

ft Figure 1 1 shows the first refinement in the fan series, the "simple fan". 

& Figure 12 illustrates the next refinement step, the "balanced fan." 

y Figure 13 illustrates the next refinement, the "balanced asymmetric fan." 

16 Figure 14 illustrates the next refinement, the first version of the "balanced radically asymmetric 

17 fan." 

18 Figure 15 illustrates the final alignment target shape, the "balanced radically asymmetric fan", 

19 which is considered a superb universal alignment target. 

20 Figure 16 illustrates an apparatus for locating objects using cooperative targets. 
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1 Detailed Description of the Drawings 

2 Figure 1 shows a typical cooperative target in common use, and illustrates some of the basic 

3 properties of targets considered by the invention. 

4 Practical targets are characterized by discontinuities of some quantity (i.e. brightness, texture) at 

5 some appropriate granularity (spatial resolution). These discontinuities are boundary contours 100 

6 (sometimes called edges), physical or subjective, that separate roughly uniform regions 110 and 

7 120. Although it is possible to imagine targets with no uniform regions and no discontinuities, 

8 they are hard to fabricate and generally unreUable due to the well-known observation that image 

9 shading is much less consistent under real-world variations than the shape and position of the 

10 boundaries. Thus from this point forward we consider only targets characterized by boundaries 

1 1 separating roughly uniform regions, 

© We avoid all consideration of shading in the engineering of a target and consider only the shape 

M of the boundaries. All shadings that can produce the boundaries are considered equivalent, and 

fl for simplicity we assume binary shading on the real plane. When targets are rendered on a 

iJ discrete grid, however, the boundaries must be carefully shaded in gray-scale to convey accurate 

f 5 boundary position and orientation information. 

O Information about a target's position is to be found exclusively along the boundary contours, for 

example 100. In uniform or uniformly- varying regions, for example 110 and 120, no position 

0 information is available for the simple reason that all points is such regions look the same. This 

20 is a fact of geometry that is independent of the alignment method — even area-based methods 

21 such as normalized correlation ultimately get their position information from these boundaries. 

22 It is well-known that the shape of the boundary contours has some bearing on the ability of a 

23 target to provide information for specific degrees of freedom. For example it has long been 

24 observed that a circle cannot be used to measure rotation, a comer cannot be used to measure 

25 size, and a rectangle provides more translation information normal to its long axis than its short 

26 axis. These bits of intuition can be formalized, resulting in formulas for computmg figures of 

27 merit that allow one to assess quantitatively the ability of a given shape to measure a given 

28 degree of freedom. The figures of merit are non-negative unbounded real numbers. For rotation 
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1 and size, a single number each is defined. For translation, the figure of merit is a function of 

2 direction, 

3 Alignment accuracy is determined by a combination of factors, the most important being the 

4 intrinsic capabilities of the alignment method, the information content of the target, and the 

5 magnitude of image degradation. The figures of merit measure the information content of the 

6 target only, and thus do not directly determine accuracy. Their value is that they allow targets to 

7 be compared quantitatively and independent of the alignment method in use. 

8 Figure 2 illustrates how the figures of merit are computed. Let the parameter s be arc length 

9 along a contour. Consider a small segment 200 of contour of length ds, at position defined by the 

10 vector p(^) 210 relative to some point cp 220. Define the unit vector U(^) 240 normal to the 

1 1 contour at p, and the unit vector u{0) 230 in direction 0, all as shown in figure 2. 

& The contribution to the figure of merit of a given degree of freedom by the segment is the area 

If swept out by the segment per unit change in the degree of freedom. For rotation and size the 

M change is about the point cp, further defined below. Thus segments oriented parallel to the 

M direction of motion induced by a change in the degree of freedom sweep no area and contribute 

J6 nothing to the figure of merit, and segments oriented normal to the direction of motion contribute 

|7 the most. For rotation and size, the contribution is proportional to distance from cp, which is 

H consistent with one's intuition. 

J$ From this discussion, the rotation, size, and translation figures of merit for any contour can be 

20 written as follows (note that the vector cross product in 2 dimensions produces a scalar): 

21 /? = ||u(5)xp(^)|^/5 (1) 

22 5 = ||u(5)#p(5)|j5 (2) 

23 T(e)^j\u{s)^u(e)\ds (3) 

24 R and S are meaningless without a suitable choice for cp. Indeed one could make R and S 

25 arbitrarily large for any contour simply by choosing cp to be far away. One useful choice is the 
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1 geometric point that minimizes the integral of squared distance between it and lines passing 

2 through and normal to the contour, which we call the center of projection. The center of 

3 projection can be computed as follows, where the x and y subscripts denote components of a 

4 vector; 

5 ^(5)=p(5)*U(5) (4) 

6 g ^ ^ul{s)ds ^ul{s)ds -^u^{s)Uy{s)ds^ (5) 
<^Px = [jq(s)u^{s)ds jul{s)ds - jq{s)Uy{s)ds ju^{s)Uy(s)ds^ g 
<^Py = ljq(s>y(^)ds jul{s)ds - jq{s)u^(s)ds ju^{s)Uy(s)ds]^g 



(6a) 
(6b) 



]^ Figure 3 illustrates an accidental alignment of a target to the machine vision system's pixel grid, 

© which results in loss of information as discussed in the following paragraphs, 

p The figures of merit consider targets to be continuous boundary contours in the real plane. This 

© is fine for analysis, but in practice images are represented as values on a discrete grid, for 

Is example 300, Unlike the real plane a grid is distinctly anisotropic — it has special directions, 

If parallel to the grid axes and, to a lesser extent, parallel to the diagonals, which affect the 

IB information-bearing capacity of target boundaries that line up along those directions. The effect 

ft is subtle but significant, particularly for alignment methods with high intrinsic accuracy. 

17 Consider the one-dimensional image intensity profile normal to a boundary contour, for example 

18 310, 320, or 340, at some point. If the boundary moves by a whole pixel amount, the profile shifts 

19 correspondingly but its shape is unchanged. For fractional pixel shifts the profile shape changes, 

20 so that the shape of the profile encodes information about sub-pixel position, although there are 

21 practical limits on how much information can be extracted at any given point. If we consider the 

22 information provided by many such profiles at many points along the boundary, however, a 

23 significant improvement in position information content can be obtained, but only if the various 

24 boundary points represent statistically independent measurements. 
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1 If a target boundary cuts the pixel grid 300 in a random or pseudo-random manner, for example 

2 320 and 340, statistical independence is high and maximum information is conveyed. On the other 

3 hand, if a portion of a boundary contour happens to line up parallel to a grid axis, for example 

4 310, the intensity profile shapes at points along that portion are necessarily identical (except for 

5 measurement noise), and therefore provide no mutually independent information. It is as if only 

6 one point along the boundary portion is considered uistead of many. Such an accidental 

7 alignment of target 310 to grid 300, and the resulting loss of information, is called a grid 

8 degeneracy. Grid degeneracy in principle affects any alignment method, whether intensity 

9 profiles are examined directly or only indirectly, but is most noticeable when the alignment 

10 method's intrinsic accuracy is very high. 

1 1 The loss of accuracy associated with grid degeneracy is not always apparent. Some alignment 

12 methods do not have sufficient intrinsic accuracy for the effect to be measurable. In other cases, 
P a method may use a model of intensity profile shape that happens to match well the behavior of 

specific images being tested. This may mask the grid degeneracy for those images, but since 

S profile behavior is not reliable to high precision such a result is unreliable in practice. 

S Targets such as crosses, for example 310 and 320, and rectangles suffer most seriously from grid 

17 degeneracies because the entire boundary can be aligned simultaneously with the grid axes, as in 

If 310. The worst case for such figures occurs when the target dimensions are close to a whole 

B number of pixels, because no independent measurements are made anywhere along the entire 

^ boundary. If the dimensions are not close to a whole number of pixels, then at least some 

21 independent information can be obtained from different edges of the target (e.g. the left and right 

22 side of a rectangle). 

23 Susceptibility to grid degeneracy is an important accuracy criterion in the engineering of an 

24 alignment target. A figure of merit GD one can use is the fraction of the target's boundary 

25 contours that can align with the pixel grid simultaneously. For rectangles and crosses GD is LO, 

26 the worst case. For circles 340 it is 0, the best case. Note that this figure of merit doesn't consider 

27 the effect of whole pixel dimensions. 

28 Figure 4 illustrates the alignment speed criteria used, as further discussed in the following 

29 paragraphs. 
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1 For most practical alignment methods, the most important effect on speed of the engineering of a 

2 target is the extent to which the target can be identified unambiguously by its coarse features. 

3 This criterion is hard to quantify meaningfully, and so is more a matter of judgement. Fine detail 

4 itself is not a problem, but for best alignment speed it should be used to enhance accuracy and 

5 not to identify the target. 

6 For example the thin cross 400 fails to satisfy this criterion, and is a poor choice for an alignment 

7 target. The cross 400 has only fine detail, no coarse features that can be used to estimate its 

8 location in a coarse resolution examination of the image. 

9 Unambiguous identity based on coarse features applies to each of the degrees of freedom, 

10 Consider for example the target 420. The x-y position of this target is unambiguous when looking 

1 1 at its coarsest feature, the overall square shape. Its orientation, on the other hand, has 90° 
ambiguities until one looks at its finest feature 430. Although one should expect an aUgnment 

II method to be able to determine the rotation of this target over a 0 - 360° range, the alignment 

tt time will be longer because fine detail must be examined in order to do so. Note that target 400 

ffS fails the speed criterion in all degrees of freedom. 

16 Figure 5 illustrates the alignment yield criteria used, as further discussed in the following 

J7 paragraphs. 

^ In general the most significant factor affecting alignment yield is image degradation — if images 

W were always perfect copies of the trained pattem, just about any alignment method would give 

20 100% yield. Although image degradation may be intrinsic to the manufacturing process and 

21 difficult to control, there are some target engineering criteria that can help. 

22 One form of degradation is where the target fails to survive the manufacturing process 

23 reasonably intact. For the most part survivability is an application-specific issue, but we can 

24 reasonably assume in general that coarse features will survive better than fine features. This is 

25 consistent with and perhaps more restrictive than the speed criterion, suggesting that at least for a 

26 UAT very fine features should be avoided. 

27 The effects of degradation are mitigated when the target's shape is as dissimilar as possible both 

28 from other patterns in the field of view and from translated, rotated, or sized versions of the 
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1 target itself (i.e., low auto-correlation secondary peak in all degrees of freedom). If the target is 

2 too similar in appearance to other patterns or itself, image degradation can wipe out differences 

3 and cause failures to find or misalignments. For example the target 420 is very similar to itself in 

4 90^ rotations. If image quality degrades significantly as in 500, the small difference 510 between 

5 the correct and false orientations can be hard to detect reliably. 

6 Another example of self-similarity is a triangle in the size degree of freedom. Fully two-thirds of 

7 the boundary of a triangle will match a larger version of the same shape. 

8 Similarity to other patterns in the field of view is of course application-specific, but again general 

9 guidelines are possible. Parallel and orthogonal features, and simple geometric shapes, are 

10 common in manufactured goods and are therefore best avoided in an alignment target intended to 

1 1 be universal. 

CE Consider for example a portion of a printed circuit board 530 containing circuit traces 550 and an 

14 alignment target 540. Note that the traces in area 560 match 75% of the target 540. As long as 

ft image quality is near perfect the false target 560 can be distinguished from the real target 540. 

tS Under realistic conditions of image degradation, however, the similarity of area 560 to target 540 

J6 will result in a non-zero error rate. 

Ct Figure 6 illustrates a target defined by a set of algebraic formulas to satisfy the ease of use 

Q criteria, as further discussed in the following paragraphs. 

¥1 An alignment target should be easy to render, train, and analyze. Training includes both 

20 producing suitable shape information for an alignment method and selecting a known reference 

21 point on the target for reporting alignment position. Analysis includes computing the figures of 

22 merit. 

23 Since all alignment methods in common use can be trained from images, and since there is no 

24 other generally accepted format for providing shape information, a high quality pixel-grid 

25 rendering of a target is considered necessary and sufficient for training a target. Realistically 

26 shaded edges are considered essential for providing accurate shape information, so for example 

27 targets generated by the typical "paint" programs are unacceptable. 
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1 Targets drawn by hand using painting or drawing programs, or acquired from a physical device 

2 such as a video camera, are difficult to analyze, usually do not allow precise selection of a 

3 reference point, and may be difficult to render in whatever substrate will contain the target in the 

4 alignment application. Such targets are not suitable for use as a UAT. 

5 The objectives are met by targets that are defined algebraically in the real plane. In a preferred 

6 embodiment, a target is defined by a real- valued function of real-valued coordinates f(x, y) such 

7 that f gives at each point (x, y) the distance and direction (-h or -) to the nearest boundary 

8 contour. The contours are defined by f(x, y) = 0, the points inside the contours as f(x, y) > 0, and 

9 outside as f(x, y) < 0. 

10 For computational simplicity the method does not require that f(x, y) give precise distance, only 

1 1 that the value is reasonably close. This simplification has been found useful for targets best 
© defined in polar coordinates, such as the fan configurations, which are derived from the 

j| function's Cartesian arguments, 

ft For example target 600 is a square of radius 610 r, and with comers rounded to radius 620 c. The 
target is defined according to a preferred embodiment by defining the function f using the set of 

f6 algebraic formulas 630. 



O A set of algebraic formulas defining a target provides a universal and unambiguous definition, 

M which can serve as the basis for a computer program that can render the target for various 

11 purposes: 

20 Training The rendering program can produce a bitmap image that can be fed 

21 directly to an alignment method for training. The target reference point is 

22 also defined algebraically. As a result, training is fully automatic, with no 

23 human involvement and no need to even acquire a training image from a 

24 camera. 

25 Reproduction The rendering program can be used to reproduce the target on the substrate 

26 used in the alignment application. Source code for the program can be 

27 delivered to manufacturers of CAD systems, laser engravers, and the like 

28 for use in their products. Source code is absolutely precise and 
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1 unambiguous, can be independently tested and certified, can be distributed 

2 by email or published on Web sites, and is ultimately what just about any 

3 mechanical rendering device will need. Of course what makes a target 

4 easy to render is somewhat application-specific. For example, some 

5 processes may be able to render only horizontal and vertical features, 

6 Nevertheless algebraically-defined targets with appropriate software are 

7 flexible enough to handle most application-specific requirements. 

8 Documentation The rendering program can produce pictures of the target for written 

9 documentation, as was done in the production of this patent specification. 

10 Analysis The rendering program is used to drive analysis software that computes 

1 1 figures of merit by numerical integration. Since the rendering program 
IE itself drives the numerical integration, the results are guaranteed to 

correspond to the target as rendered. 

fl Testing The target is defined on the real plane and the rendering program 

is approximates this using high-precision floating point calculations. As a 

f 5 result the target can be translated, rotated, and sized to effectively arbitrary 

M precision prior to rendering as a discrete image. Various edge, lens, and 

Em noise models can be applied in the floating point domain. The resulting 

Q images can be used for fully automated accuracy, speed, and yield testing. 

20 Figure 7 illustrates a preferred rendering method according to the invention. This method for 

21 algebraic rendering and analysis of targets has been found by experience to be remarkably 

22 simple, as measured in number of lines of code needed, and in general, as measured by the 

23 variety of targets that can be generated. Following the preferred method, a target is defined by a 

24 real-valued function of real-valued coordinates f(x, y) as described above and illustrated by 

25 example in figure 6. 

26 A scan pattern generation step 700 is used to generate a sequence of real-valued coordinates (x, y) 

27 as appropriate for the rendering to be made. For example, to render a bitmap image the 
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1 coordinates would correspond to the centers of the image pixels. For guiding a laser engraver, 

2 the coordinates would correspond to beam position. 

3 An optional lens model step 7io is used to apply a coordinate transform to model the imaging 

4 geometry, which maps the scan pattern coordinates (x, y) to new coordinates (x\ y'). Typically 

5 an identity transform is used, but translation, rotation, size, aspect ratio, skew, perspective, and 

6 lens distortion transforms can be applied. These transforms are of particular value for alignment 

7 method accuracy testing, because the amount of transformation is precisely known. 

8 A computational step 720 is used to compute the shape-defining function f(x', y'), which results 

9 in a real- values estimate of distance to the nearest boundary contour. 

10 An edge model step 730 is used to apply a real- valued brightness transform that models edge 

11 sharpness, focus, video gain, noise, and other physical processes. 

SI A digitizer model step 740 is used to convert the brightness values / as appropriate for the final 

P rendering, for example 8 -bit integers for monochrome bitmap images 750. 

W4 The only target-specific software needed is the code to implement the function f(x, y) in step 720. 

15 The above example target of figure 6 requires around 20 lines of code in the Visual Basic 

^ programming language; the complex UAT shown in figure 15 requires around 200. 

O Target-independent software follows the target contours defined by f(x, y) = 0 and performs the 

Jl^ numerical integration needed to compute the figures of merit. A small amount of target-specific 

19 software to provide a list of contour starting points is used. The contour following software can 

20 also generate a line-drawing of the target if such is needed. 

21 A system for target generation follows an object-oriented approach with targets implemented by 

22 polymorphic objects and used by target-independent rendering and analysis software. Such a 

23 system would include a GUI for parameter selection and display of images and other results. 

24 The above description relies on hard-coded implementations of f(x, y), which results in high 

25 rendering speed and simple software design. It is also possible to implement a "universal" 

26 function fu that uses a general-purpose shape description in the form of lines and arcs, such as a 
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1 CAD description. With such a method creating a new target shape would be simpler and require 

2 no programming, but a larger one-time software effort would be needed to implement fu and 

3 rendering and analysis would be slower. A complete system for target generation would include 

4 both universal and specialized functions. 

5 Figure 8 shows an edge model used in a preferred embodiment of rendering step 730. The figure 

6 shows the f coordinate axis 800, which represents distance (+ or -) to the nearest boundary 

7 contour, and the brightness coordinate axis 820. In a preferred embodiment, a sigmoid function 

8 840 is used: 

T 1 7 T contrast 

9 1 = background H — (7) 

10 This edge model is easy and fast to compute, produces excellent anti-aliased edges, and allows 

3Q. precise control of edge sharpness using the parameter a. 

ft Figure 9 illustrates some common alignment targets that are used as a reference point in the 

IP engineering of novel, high performance targets according to the invention. For clarity we start 

p- with simple geometric shapes and build in small steps towards the goal. It should be clear that 

15 the resulting UAT is not unique, and that many variations, both minor and substantial, would be 

^ consistent with the spirit of the procedure and may be more suitable for specific applications, 

W Speed and yield criteria are based on an analysis of the degree of similarity between the target 

© and other patterns. Similarity is somewhat dependent on the alignment method in use, 

19 particularly on whether the method is primarily based on areas, or on boundaries. While 

20 different methods may disagree on the degree of similarity between two patterns, in general there . 

21 is necessarily much more agreement than disagreement. 

22 In the following development, similarity is considered based on boundary matching, not area 

23 matching. While the analysis is therefore more directly applicable to boundary-based methods, it 

24 is still largely method independent since boundary shape determmes area shape. The UAT that 

25 results is a superb target for use with just about any general-purpose method. 

26 Consider first a circle 900 of radius r. The figures of merit are given in table 1. 
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1 



Table 1 . Circle 


R 


S 


worst 7(9) 


best 7(9) 


GD 


0 


6.28 


4.0 r 


4.0 r 


0 



2 As can be seen there is no information for measuring rotation and no grid degeneracy. The scale 

3 figure of merit is pretty good but the translation figure could be better. If we ignore the rotation 

4 degree of freedom, speed and yield criteria are satisfied as long as no similar shapes appear in the 

5 field of view. Circles are common shapes, however. Of course we don't need all of this analysis 

6 to know that a circle is a poor choices for a UAT, but the numbers give a point of comparison 

7 when considering other shapes. 

Now consider a square 920 of radius r, whose figures of merit are given in table 2. 



Table 2. Square 


R 


S 


worst r(0) 


best T(B) 


GD 


4.0 


8.0 


4.0 r@ 0° 


5.66 r@ 45° 


1.0 



All degrees of freedom can be measured, although twice as much information is available to 

il measure size as rotation (these figures can be compared dnectly, but cannot meaningfully be 

Tl compared with the translation figures). A factor of V2 imbalance also exists between the best and 

13 worst translation directions. These imbalances are not serious, but neither are they ideal. Grid 

14 degeneracy is worst case. Speed is good, but the square will match itself perfectly at 90° rotation 

15 increments, and 50% of its boundary will match a comer or a much larger square. These self- 

16 similarities, combined with the fact that it is a common shape, fail to satisfy our yield criteria. 

17 Next consider a cross 940 of radius (half- width) r and arm radius (half-thickness) a, whose 

18 figures are given in table 3. 
19 
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Table 3. Cross 


R 


S 


worst r(G) 


best W) 


GD 


4.0 


S.0a{2r-a) 


4.0 r@ 0° 


5.66 r@ 45° 


1.0 



1 Interestingly, except for the size degree of freedom the figures are identical to those of a square. 

2 This makes sense since the boundaries of a cross are identical to those of a square in perimeter 

3 length and orientation; a cross is just a square with its comers folded in. Considering just these 

4 figures of merit, then, a cross is never better than a square, and always worse in size 

5 measurement capability. 

6 Other factors may come into play, however. Recall that GD does not capture the ability to 

7 mitigate the effects of grid degeneracy by choosing the dimensions of the target to be non-whole- 
pixel amounts. With a square there are only two independent edges potentially providing 

IB translation information (it's not 4 because there are 2 translation degrees of ft*eedom). With a 

ff) cross with sufficiently thick arms, we get 4 edges for each translation degree of freedom, 

11 assuming that none of the 6 possible pairs of the 4 edges are separated by a whole number of 

12 pixels. Thus a cross can be made less susceptible to grid degeneracy than a square, but only by 
|3 careful engineering. 

M- Another factor that might favor a cross is that in some applications scene real estate may be too 

t| limited to allow using a square, but a cross can be squeezed in between other portions of the 

M> scene, 

17 Thin crosses fail to meet the speed criteria due to lack of coarse features, and all crosses suffer 

18 from the same yield concerns as squares. 

19 Since crosses are commonly used as alignment targets in spite of these problems, the above 

20 analysis is summarized in the following guidelines for their use: 

21 1 . Make the arms as thick as possible 

22 2. Make the edge-to-edge dimensions not be whole numbers of pixels. 
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1 3, Round the comers if possible to further reduce grid degeneracy. 

2 Figure 10 illustrates a starting shape according to a preferred embodiment of the target 

3 engineering method of the invention. This starting point and the shapes derived from it have 

4 proven to be productive in engineering superb alignment targets. The shapes are based on a basic 

5 shape-type that we call a /an. Other starting points and refinement decisions are possible, and no 

6 implication is made that the fan shapes are best. They are the best we've developed to date, 

7 however, and the principles used to engineer them can be applied in exploring other 

8 configurations. 

9 The primitive fan shape (primfan) is shown in figure 10. It consists of 4 blades 1000 connected to 

10 a central circular hub 1010. All inner and outer comers, for example 1020, are rounded to avoid 

1 1 sharp comers that are hard to fabricate in many substrates, and often fail to survive harsh 
environments 

All of the fan shapes that are considered herein are defined by straight-line segments in polar 

& coordinates. The vertices where these segments intersect are rounded by segments of circles, also 

P in polar coordinates for simplicity. Thus the actual shape of the rounded comers in the final 

t6 Cartesian rendering is complex, but for the small radii used they look just fine. A plane figure 

M constructed from line segments in polar coordinates, with optionally rounded vertices, is called a 

generalized polar polygon. 

© In figure 10 the primfan is also drawn in a polar coordinate system 1050. The blades 1060 and hub 

20 1070 can be seen. 

21 Here and below the radius of the fan is r. The parameters defining this particular primfan are 

22 given in table 4, and the figures of merit in table 5. 
23 
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Table 4. Primfan parameters 


Fan radius 


r 


hub radius 


0.2 r 


blade width 1035 


45^ 


blade gap width 1030 


45° 


comer radius 


0.047 r 



1 



Table 5. Primfan 


R 


S 


worst T(Q) 


best TiQ) 


GD 


3.84 


3.27 


6.11 r@ 22.5° 


6.50 r@0° 


0.31 



The worst case translation figure for the fan is better than the best case for circles, squares, and 
crosses of equal radius, and 53% better than the worst case for those targets. This is because 

^% more perimeter is packed into the same area, and better balanced in orientation. GD is pretty 

. 5 good at 0.31, corresponding to 4 of the 8 blade edges simultaneously subjected to grid 

3 degeneracy. The figures for rotation and size are a Uttle small and somewhat imbalanced, but not 

10 bad either. 

15 Speed is excellent due to unambiguous coarse features. There is of course the 90° symmetry, and 

9 self-similarity in size is also too large due to the fact that the radial features, which comprise 

10 63% of the total perimeter, match perfectly as size changes. The fan is not a common shape, 

1 1 however, and is not likely to be confused with other patterns in the field of view. 

12 Figure 1 1 shows the first refinement in the fan series. Holes 1100 are added in the blades, 

13 resulting in the simple fan shape 1110 (simfan), with hole parameters given in table 6 and figures 

14 of merit in table 7. The simfan is also drawn in polar coordinates 1120. 
15 
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Table 6. Simfan hole parameters 


hole inner radius 


0.5 r 


hole outer radius 


0.8 r 


hole width 


15° 



1 The additional perimeter improves all of the figures of merit. R and S are somewhat more 

2 imbalanced, though, as the defined boundary squeezes more information out of the rotation 

3 degree of freedom than size. 
4 



Table 7. Simfan 


R 


S 


worst T(Q) 


best 7(9) 


GD 


5.40 


4.19 P 


8.20 r@ 45° 


8.83 r@0° 


0.24 



^ Speed is still expected to be excellent. The rotation 90° ambiguity hasn't been addressed, but the 
size self-similarities are reduced because the holes won't match at the wrong size. 

12 Figure 12 illustrates the next refinement step. One advantage of the fan configuration is that 

^3 since it is composed of radial and circular features, rotation and size performance can be 

1;^ controlled independently. With a simple change we can bring up S without affecting R. The 

1^ result 1200 is called a balanced fan (balfan), also shown in polar coordinates 1220. The defining 

1 1 parameters given in table 8, and the figures of merit in table 9. 
12 



Table 8. Balfan parameters 


Fan radius 


r 


hub radius 


0.2 r 


blade width 1235 


56° 


blade gap width 1230 


34° 


comer radius 


0.047 r 
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hole inner radius 


0.5 r 


hole outer radius 


0.8 r 


hole width 


18.67^ 



1 Note that all we've done is widen the blades to 56°, and widen the holes proportionally (the 

2 holes are 1/3"* the blade width). 

3 



Table 9. Balfan 


R 


S 


worst T(Q) 


best r(0) 


GD 


5.40 


5.15 


8.92 r@ 45° 


9.31 r@0° 


0.22 



\fl Note that the figures of merit are fairly well balanced, hence the name of the fan, and 

.fS numerically better than simfan and much better than any of the simple geometric shapes we 

S considered above. Speed and yield are neither better nor worse than simfan. 

|7 Figure 13 illustrates the next refinement, which is to fix the 90° ambiguity. This is done by 

y8 making each blade and gap a different size. The resulting shape 1300 is called a balanced 

■"^ asymmetric fan (basfan), also shown in polar coordinates 1350. This basfan has the same total 

© blade and gap width as the balfan, so that the figures of merit that we worked to balance are not 
significantly changed. As before the holes are kept at 1/3^*^ the blade width. 

12 The parameters describing the blades are given in tables 10a and 10b, with figures of merit in 

13 table 11. All of the radial and rounding parameters are as for previous fans. 
14 
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Table 10a. Basfan parameters 


Blade 


Starting Azimuth 


Width 


1310, 1360 


0° 


38° 


1320, 1370 


57° 


50° 


1330, 1380 


146° 


74° 


1340, 1390 


269° 


62° 



1 

2 



Table 11. Basfan 


R 


S 


worst T{%) 


best 7(0) 


GD 


5.42 ? 


5.21 


8.64 r@ 38° 


9.47 r @ 134° 


0.11 



ft Note, as expected, that R and S are not significantly changed from balfan. The worst case T(d) 

% j has dropped slightly, with the best case rising, which is not surprising. GD has gone down by 

- 5 half, since now no more than two blade edges can suffer simultaneously from grid degeneracy. 

f-6 Note that with 8 blade edges and 28 pairs it is essentially impossible to reduce this to just one 
edge, since the test for simultaneous grid alignment has to allow for approximate alignment. 

|!8 Although we've eliminated the serious 90^ ambiguity, there is still some rotation and size sel^ 

9 similarity in the basfan. Considering rotation, any blade edge will match any other at some angle, 

10 and any point on the circumference will match any other point on the circumference. The 

1 1 asynmietry of the basfan reduces but does not eliminate these matches, which will result in 

12 secondary auto-correlation peaks. Li size, the blade edges will match over a wide range of sizes, 

13 although the radial edges of the holes will not, 

14 In summary the basfan is good on all criteria of speed, accuracy, and yield, but there is still room 

1 5 for improvement. 
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1 Figure 14 illustrates the next refinement. The radial features of previous fan configurations cause 

2 both grid degeneracy and self-similarity in size, A simple change to the formulas defining the fan 

3 in polar coordinates allows us to generate radial features that are sections of spiral curves, 

4 resulting in shape 1400. This is the first of two steps leading towards our final fan configuration, 

5 the balanced radically asymmetric fan (bradfan). 

6 In polar coordinates, the bradfan after the first modification 1450 can be compared with the 

7 basfan 1350, Considering a particular blade 1404, the dotted lines show the blade edges before the 

8 change (basfan), and the solid lines show the blade and hole for bradfan 1400, 1450, As can be 

9 seen, the outer edge of the blade has not moved, but where the blade connects with the hub has 
10 been moved by an amount 1406 called skew. 



1 1 The blade parameters for the bradfan so far are given in table 12. 





Table 12. Bradfan parameters, step 1 




Blade 


Starting Azimuth 


Width 


Skew 




1410, 1460 


0° 


38° 


11° 




1420, 1470 


57° 


50° 


-11° 




1430, 1480 


146° 


74° 


-22° 




1440, 1490 


269° 


62° 


22° 



13 This simple change eliminates all straight radial features in the final rendering, which eliminates 

14 grid degeneracy and size self-similarity. The skew parameters are chosen to be different for each 

15 blade, so that blade edges will not match those of other blades under rotation. This reduces some, 

16 but not most, of the rotation self-similarity. All figures of merit improve over basfan, as can be 

17 seenin table 13. 
18 
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Table 13. Bradfan step 1 


R 


S 


worst T(Q) 


best T(Q) 


GD 


5.88 


5.71 


8.82 r@ 37° 


9.51 r@ 137° 


0 



1 Figure 15 illustrates the second and final step in making tht bradfan, which eliminates the final 

2 rotation self-similarity. This is done by making the outer blade edges also spiral sections, instead 

3 of circular. The final bradfan 1500 is shown, also drawn in polar coordinates 1550. A particular 

4 bradfan blade 1504 in polar coordinates shows both the skew parameter 1506 and a new spiral 

5 parameter 1508. The complete blade parameters are given in table 14, and the final figures of 

6 merit in table 15. 

7 Unlike previous fan parameters, which were chosen by hand, these parameters were obtained by 
^ an automated search of the 41,472 distinct arrangements of the 16 blade parameters, followed by 
|f9 a manual examination of the 100 highest ranking permutations. 



Table 14. Final bradfan blade parameters 


Blade 


Starting Azimuth 


Width 


Skew 


Spiral 


1510, 1560 


0° 


62° 


22° 


0.09 r 


1520, 1570 


81° 


74° 


-11° 


0.03 r 


1530, 1580 


184° 


50° 


-22° 


-0.09 r 


1540, 1590 


283° 


38° 


11° 


-0.03 r 



1 1 The hub, hole, and rounding parameters are as before. Note that the spiral parameters are 

12 different for each blade to avoid rotation self-similarity. 
13 
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Table 15. Final bradfan 


R 


S 


worst T(Q) 


best r(9) 


GD 


6.12 


6.12 


9.06 r@ 137° 


9.50 r@ 68° 


0 



1 The worst case translation figure of merit is over 9 r, which is 225% better than, the worst case 

2 for a cross, and translation is well balanced over all angles. The automated search has given us 

3 superb and perfectly balanced R and S values. R is 53% better than a cross or square at the same 

4 radius, and S is just about what a complete circle would be. 

5 The bradfan has no fine features and so should be fast to find and survive most manufacturing 

6 processes well. It has excellent figures of merit in all degrees of fireedom and no grid degeneracy. 

7 It has no significant self-similarities in any degree of freedom, and looks nothing like any shape 
■ ;;S in common use. The bradfan is an ideal universal alignment target. 

v£9 Figure 16 illustrates an apparatus for locating objects using cooperative targets. An object 1600 is 

J3O located somewhere in space relative to some object or device intended to grip, operate on, dock 

M with, avoid, or otherwise interact with the object 1600, such as the illustrated robot gripper 1660. 

=12 The object 1600 contains a cooperative target 1610. A camera or other suitable image forming 

JD device 1620 is located in a known position and attitude in space relative to the gripper 1660, and 

till- such that the cooperative target 1610 appears in the field of view of the camera 1620. 

J$ The object's location relative to the gripper 1660 and camera 1620 may be uncertain in various 

16 degrees of freedom, including translation degrees of freedom 1680 and 1682, orientation degree of 

17 freedom 1684, and distance degree of freedom 1686. 

18 The camera 1620 is connected to a machine vision system 1630, which produces as part of its 

19 operation, using means well-known in the art, a digital image 1635, The digital image 1635 will 

20 contain an image of the cooperative target 1610. The location of the target in the image will be 

21 uncertain is various degrees of freedom, such as translation, orientation, and size, that correspond 

22 to the uncertainties in location of the object 1600 in space, for example 1680, 1682, 1684, and 1686, 

23 where said correspondence is described by well-known mathematical formulas. 
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1 The machine vision system 1630 contains an alignment algorithm 1640 that reads and analyzes the 

2 digital image 1635 to determine the location of the target in the digital image,, Using this 

3 information the machine vision system 1630 computes the location in space of the target 1610 

4 using well-known formulas, and communicates this information to some device, such as robot 

5 controller 1650, for use in gripping, operating on, docking with, avoiding, or otherwise interacting 

6 with the object 1600. 

7 In one embodiment of the mvention, the alignment algorithm 1640 is capable of aligning non- 

8 translation degrees of freedom such as orientation and size, and the cooperative target 1610 

9 conveys sufficient information in such degrees of freedom to enable the alignment algorithm 
10 1640 to make such measurements. In another embodiment of the invention, targets are used that 



1 1 have at least one of the following attributes: 

• They satisfy the invention's evaluation criteria. 

M • They result from the use of the invention's design method. 

14 • They have no significant rotational symmetry 

is • They have no significant orientation or size self-similarity 

CI ♦ They are not primarily composed of circles, circular arcs, straight lines, or right 

9 angles. 

18 In a preferred embodiment, a universal alignment target such as 1500 is used in conjunction with 

19 an alignment algorithm 1640 capable of aligning non-translation degrees of freedom, such as one 

20 of the many products available today offering such capabilities. 

21 Other modifications and implementations will occur to those skilled m the art without 

22 departing from the spirit and the scope of the invention as claimed. Accordingly, the above 

23 description is not intended to limit the invention except as indicated in the following claims. 
24 



25 What is claimed is: 
26 
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L A method for locating an object, the method comprising: 

Rendering an alignment target on the object, the alignment target being adapted to be 
substantially rotationally asymmetric and substantially size self-dissimilar; and 

Searching for the alignment target so as to provide the pose of the object. 
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1 



ABSTRACT 



2 A method and apparatus for locating objects by means of machine vision alignment using 

3 cooperative targets. Novel cooperative targets are used that have substantial performance 

4 advantages. Alignment methods having non-translation alignment capabilities are used, such as 

5 geometric pattern matching, cooperating with suitable targets to perform alignment in non- 

6 translation degrees of fireedom, such as orientation and size. 

7 
8 

9 
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Figure 5 — ^Illustration of yield criteria 
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Figure 6 — Targets deHned algebraically are easy to use 
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Figure? — ^Target rendering method 
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Figure 8 — Intensity profile function used in target rendering method 
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Figure 9 — Common alignment targets 
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Figure 12 — ^Balanced fan 
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Figure 13 — ^Balanced asymmetric fan 



Cognex Confidential 



Page 42 of 44 



Printed 10/30/00 




Figure 14 — Balanced radically asymmetric fan, step 1 




Figure 15 — Balanced radically asymmetric fan (UAT) 
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